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EFFECTIVE TRANSFER OF IMAGES FROM 



A USER TO A SERVICE PROVIDER 

CROSS REFERENCE TO RELATED APPLICATIONS 

Reference is made to commonly assigned U.S. Patent Application 

5 Serial No. 09/569,170, filed May 11, 2000, entitled "System and Apparatus for 

Automatically Forwarding Digital Images to a Service Provider" by John R. 

Fredlund, et al.; and U. S. Patent Application Serial No. 09/569,079, filed May 11, 

2000, entitled "System and Camera for Automatically Forwarding Digital Images 

to a Service Provider" by Kenneth A. Parulski, et al.; the disclosures of which are 

1 0 incorporated herein by reference. 

FIELD OF THE INVENTION 
The present invention relates to an effective method of transferring 
images to a service provider over a channel. 

BACKGROUND OF THE INVENTION 

15 The transfer of digital images from a user to a service provider is 

becoming more popular and more important. Typically, a digital camera user 
takes a plurality of digital images which are stored on a removable memory card. 
These images can be transferred from the memory card and stored, for example, 
on a hard drive or other non- volatile memory associated with the user's computer. 

20 While these images can be printed on a local printer, such as an ink jet printer, it is 
often simpler and less expensive for the user to have the images printed by a 
service provider. There are numerous services that can be provided using digital 
images, such as storing, printing, or producing digital storage media (e.g. CD-R 
discs) with duplicate copies of the digital images. These services can be provided 

25 at a remote location by a service provider. When services are ordered from a 
service provider, the images need to be uploaded using a channel such as the 
Internet. 

Digital images, from digital cameras or scanned photographic film, 
can be uploaded to a web site for viewing, as described in commonly assigned 
30 U.S. Patent 5,666,215 to Fredlund et al. Using a web browser, a group of these 
digital images can be viewed and selected for printing, for example using the 
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Kodak Photonet Service. The user can select the size of each print to be 
produced, and the quantity of prints to be made from each image. 

Album pages can be produced from digital images by arranging 
numerous images on the same page, as described in commonly assigned U.S. 
5 Patent 6,004,061 to Manico et al. These album pages can be customized in terms 
of the size and arrangement of images on the page, the size and finish of the 
album pages, and the background color or patterns used. 

Some web sites, such as the site provided by OFOTO at 
www.ofoto.com , enable a user to upload a group of digital images for sharing with 

10 others over the Internet and for providing digital printing services. This site 

permits a user to obtain an account using his e-mail address as the account name, 
and to provide a password and address information. The user can then upload a 
group of images. After all the images are uploaded, the user can select particular 
images for printing or sharing with third parties designated by the user. The user 

1 5 can return to this site at a later date, enter their e-mail address and password, and 
upload or print additional images. However, in all cases, each full resolution 
image must be uploaded to the web site before it can be selected for printing or 
sharing. 

Many existing digital cameras provide images with over two 
20 million pixels. To obtain services using these images, many large image files 
must be transferred over a channel to the service provider. Frequently, the 
channel includes a telephone modem and the Internet. As a result of the relatively 
low data rate channel, it takes a long time to transfer a large number of digital 
. image files. This makes it very inconvenient for users who want to transfer a 
25 large number of digital image files for printing, since they must wait until the 
images are uploaded before they can order services using these images. 



SUMMARY OF THE INVENTION 
It is an object of the present invention to provide an effective 
30 method for transferring images over a channel to a service provider. 

This object is achieved by a method of selecting images from a 
plurality of images previously stored in a memory location, ordering services to be 
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provided utilizing the images, and transferring such images to a remote memory 
location over a channel where the services are to be provided, comprising the 
steps of: 

a) storing a plurality of images in the memory location along 
5 with corresponding thumbnail or lower resolution corresponding images; 

b) displaying at least a subset of the thumbnail images for 
viewing by a user; 

c) the user selecting those images to be transferred after 
viewing the displayed thumbnail images; 

10 d) providing image identifiers for each selected image to be 

uploaded to the remote location and a service order which specifies the services to 
be provided utilizing such selected images; 

e) the remote location confirming the receipt of the service 

order; and 

15 f) transferring such images over the channel to the remote 

memory location at a suitable time for effective data transfer whereby the ordered 
services can be subsequently provided. 

ADVANTAGES 
It is an advantage of the present invention that the images can be 
20 transferred over the channel to a remote location at a suitable time that is selected 
for effective image transfer. That time can be selected so that it does not interfere 
with a user's operation of his or her computer or at a time when the channel, 
which may include the user's telephone line, is not under heavy demand. 

It is a further advantage of the present invention to provide a 
25 method for obtaining digital printing services using an Internet accessible server, 
which allows the user to select the time at which images are uploaded. 

It is a further advantage of the present invention to provide a 
method for obtaining customized digital printing services which stores the 
customer's preferred service options, including a user delayed upload option, in a 
30 file that can be accessed at a later time, so that the user can easily obtain the same 
selected preferred service options at a later time, without needing to recall and re- 
select their preferred service options. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
FIG. 1 depicts a block diagram of a system that implements this 

invention; 

FIG. 2 is a flow diagram of a typical transaction for providing 
5 customized photo products over a network using effective transfer of images from 
a user to a service provider; 

FIG. 3 depicts a selection of print sizes, picture frame styles, and 
picture frame mattes provided by the system of FIG. 1; 

FIG. 4 depicts an album page that can be provided by the system of 

10 FIG. 1; 

FIG. 5 is a diagram depicting service account information; 

FIG. 6 depicts in more detail a digital camera shown as a block in 

FIG. 1; and 

FIG. 7 is a graphical user interface screen to enable a user to select 

1 5 images to be uploaded and an effective transfer time. 

DETAILED DESCRIPTION OF THE INVENTION 
The present invention provides an effective method of transferring 
images to a service provider over a channel, such as the Internet. The transferred 
images may then be used to produce photo products, such as standard 

20 photographic prints, framed photographic enlargements, complete album pages, 
and PictureCD discs, or may be stored to facilitate sharing over the Internet. 
These photo products can be customized to further include customized graphics, 
text, or image templates. The user establishes a service account and selects the 
type of photo products that they prefer. The user also selects the images to be 

25 uploaded, and a preferred upload time option. The upload time option may 

represent a preferred upload initiation time, or a time window during which the 
transfer is desired. Image identifiers are provided for each image to be uploaded 
and are stored as service account information. Unlike prior art systems, the 
images are not immediately uploaded, but are instead uploaded at a later time in 

30 order to provide more effective (e.g. more convenient and less obtrusive) image 
transfer. The transaction with the user is completed, and the user can move on to 
another task, without waiting for the image uploading to be completed. At the 
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appropriate time selected by the user, the image files corresponding to the image 
identifiers are uploaded to the service provider. The service provider then 
produces the photo products using the uploaded images and the user service 
account data. 

5 As shown in FIG. 1, the system includes a home computer system 

(with associated peripherals) 10 located at the customer location (e.g., the user's 
home). The home computer system 10 also includes equipment located at a 
network service provider 30, such as an Internet service provider (ISP), which 
communicates with the home computer system 10 to provide a network 

10 connection for the customer to a channel 36, such as the Internet. The system 
further includes a fulfillment center 40 which communicates with the home 
computer system 10 and the ISP 30 to perform the steps of selecting and 
effectively transferring images, and creating and shipping a photo product 66. 
The fulfillment center 40 includes an electronic database 44, which is located 

15 remote from the user's computer 10. It is understood that a system such as a game 
console, dedicated Internet appliance, or set top box may be substituted for the 
home computer system. 

The various portions of the fulfillment center 40 can be located in a 
single building or complex of adjacent buildings, or can be geographically 

20 dispersed over several sites in different cities or even different continents. For 

example, the electronic database 44 and the album production controller 52 can be 
provided by computers located in different cities and interconnected via a suitable 
digital communications network, such as the Internet. Furthermore, the electronic 
database 44 can itself be distributed over several computers in several different 

25 locations. 

The home computer system 10* which can be, for example, a Dell 
Dimension XPS M200, includes a CPU motherboard 12, using, for example, a 
Pentium 200 MHz MMX processor as well as RAM memory. The CPU 
motherboard 12 executes software stored on a hard drive 20, for example, the well 
30 known Windows 98 operating system software and the Internet Explorer web 

browser software, both provided by Microsoft Corp. of Redmond, WA. The CPU 
motherboard 12 is coupled to a display monitor 14 and a keyboard 16. A 
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mouse 18 permits the customer to readily communicate with the CPU 
motherboard 12. The customer's computer 10 also includes a dial-in modem 22 
for communicating with the ISP 30 in order to connect to a channel 36, such as the 
Internet. 

5 The CPU motherboard 12 communicates with a color scanner 4, 

such as a Microtek ScanMaker E6, which can scan color photographs (not shown) 
and store digital images of the photographs on the hard drive 20. The CPU 
motherboard 12 also communicates with a CD reader 2. The CD reader 2 can be 
used to input digital images from a CD-R disc, such as a Kodak PictureCD (not 

10 shown). The CPU motherboard 12 also communicates with a digital camera 6 via 
a suitable interface, such as the well known USB or RS-232 serial interfaces. The 
digital camera 6, for example a Kodak DC280 Zoom digital camera, can be used 
to provide digital images. The digital images provided by the CD reader 2, 
scanner 4, and digital camera 6 can be uploaded from the home computer system 

15 10 to the fulfillment center 40 via ISP 30 and channel 36. 

The ISP 30, for example, Earthlink Network, Inc. of Pasadena, CA, 
includes banks of modems 32, one of which is connected to communicate with the 
modem 22 of the customers computer 10. The modem 32 in turn communicates 
with computers/routers 34 in order to provide a connection to the channel 36 using 

20 equipment and techniques well known to those skilled in the art. 

The fulfillment center 40 is connected to the channel 36, such as 
the Internet, by a network server 42, such as an Internet server, which is 
comprised of one or more computers and associated peripherals. The electronic 
database 44 provides information describing numerous photo product options, 

25 including printing a group of digital images onto album pages. The electronic 

database 44 can be contained on the same computer as the network server 42, or 
can utilize a separate computer, or can be distributed over several computers at the 
same physical site, or at different sites. 

The electronic database 44 includes information describing 

30 different features of the albums and other photo products 66 that can be selected 
and customized by the customer at the remote location, using the customer's 
computer 10. The electronic database 44 includes information describing photo 
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product options, for example album features such as providing various 
background colors or textures, page numbers, page captions, image captions, etc. 
The album pages can be bound in a cover, or can include holes to permit the pages 
to be inserted into a standard binder, such as a three-ring binder. These album 
5 feature options can be demonstrated via software programs, for example, JAVA 
applets, MPEG or QuickTime movies, or Shockwave files, which depict the 
functionality of features that the customer can choose. 

When a photo product 66 is purchased by the user, the electronic 
database 44 communicates with a billing system 46 to verify that the payment 

10 identifier (e.g., credit card or debit card number) provided by the customer is 

valid, and to debit the account for the purchase. As shown in block 48, the bill is 
issued. The customer's account that is debited can, of course, be located at a 
remote financial institution. Typically, as with credit cards, this financial 
institution will make payment to the direct provider or seller of shippable photo 

15 product 66. This is generally done by wiring the amount into the direct provider's 
account, generally an account established with another financial institution. 

As shown in FIG. 1 , the electronic database 44 is connected to 
production controller 52. The production controller 52 controls one or more color 
hardcopy printers 54, which can produce album pages 56 or separate hardcopy 

20 prints 58. The hardcopy prints can be placed in frames 68. The production 

controller 52 is also connected to a CD writer 76, which can produce PictureCDs 
76 having digital images and application software for using the digital images. 
The production controller 52 can optionally be connected to devices (not shown) 
for producing t-shirts, coffee mugs, etc. incorporating one or more images 

25 uploaded by the user. The production controller 52 is also connected to an album 
label printer 60 which produces labels that can be attached to a standard album 
cover to provide custom album cover 62. 

The electronic database 44 also optionally provides long-term 
storage of the uploaded images. In this embodiment, stored images are accessible 

30 (e.g. viewable) via the Internet by authorized users, as described, for example, in 
commonly assigned U.S. Patent 5,760,917 to Sheridan, the disclosure of which are 
herein incorporated by reference. 
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The production controller 52 also controls a shipping label 
printer 70 to produce a shipping label 74. The shipping label 74 is attached to a 
shipping container 64 (e.g., a cardboard box containing packing material) that 
contains and protects the photo product 66 during shipment (e.g., via air express 
5 mail, ground carrier, etc.) to the customer or the customer's designee. 

Turning now to FIG. 2, there is shown a flow diagram of a typical 
method for effectively transferring images from a user to a service provider to 
produce photo products, such as prints, albums, PictureCDs, etc. As shown in 
block 1 00, the customer, using a digital communication network, logs onto the 

10 channel 36, which can be the Internet. The customer can, of course, use a service 
provider, such as the ISP 30, to gain access to the channel 36. The ISP 30 uses an 
address, such as an Internet protocol (IP) address, to establish a connection 
between the customer's computer 10 and a product provider or seller which owns 
or controls the fulfillment center 40. 

15 In block 102, the customer enters their name, selects a password, 

and provides delivery and billing information. This information identifies the 
customer and the customer's designee (e.g. the person to whom the photo product 
66 should be shipped, which can of course be the customer). It includes addresses 
of both the customer and one or more of the customer's designees. The customer 

20 also identifies an account to be debited to pay for the photo product(s) to be 
purchased. Often this will be a credit card having a payment identifier that 
specifies the account of the customer to be charged or debited. Frequently, this 
will be in a financial institution. The payment identifier can be a credit card 
number that specifies a particular credit card account. As used in this 

25 specification, a credit card will also include a debit card. 

In block 104, a user service account is established for the customer. 
The information stored in the service account includes the information entered by 
the customer in block 102. This service account information will later be 
augmented by additional information listing the photo product options selected by 

30 the customer, and image identifiers that correspond to image files to be uploaded 
from the customer's computer 10 to the fulfillment center 40. FIG. 5 provides an 
example of the service account information. The billing information (e.g. credit 
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card number) and other sensitive information provided in the service account can 
be encrypted to prevent discovery and unauthorized use. The service account 
information is preferably stored as part of the electronic database 44 of the 
fulfillment center 40. Alternatively, it is possible for some of the service account 
5 information to be stored in the customer's computer 10, for example on the hard 
drive 20. For example, the image identifiers corresponding to images to be 
uploaded can be stored using hard drive 20. 

In block 106, the fulfillment center 40 provides the customer with a 
menu of photo products 66 that are available for customization and purchase, such 

10 as standard service prints, framed hardcopy prints as depicted in FIG. 3, and 

customized photo albums as depicted in FIG. 4. In block 108 the customer selects 
what type of products (e.g. standard service prints, framed hardcopy prints, or 
customized photo albums) to purchase. The fulfillment center 40 can also provide 
the customer with preferred times for image uploads. In this fashion, the 

1 5 fulfillment center can optimize throughput and minimize the possibility of excess 
incoming data. The fulfillment center 40 can provide incentives such as lower 
prices or free products for preferred upload times. 

In block 110, the network server 42 provides a menu of 
customizable features for the type of product selected by the user. This menu is 

20 displayed on display monitor 14 if the user is located at the home computer 

system 10. In block 112, the customer selects preferred features for the product 
type they selected in block 108. 

The options for standard prints include providing the prints in 
various sizes (e.g. 3" x 5", 4" x 6", etc.) and various surface finishes (e.g. glossy, 

25 matte finish, etc.). The standard prints can also include text, such as the date the 
picture was captured or printed. The date the pictures were captured can be 
obtained from the digital image file to be uploaded, if the picture was taken by a 
digital camera or by an APS film camera having a real-time clock. The user can 
select whether or not to include this date stamp, where to position the text (e.g. on 

30 the front at the lower left, or on the back of the print.). The user can also select 
the color (e.g. white or yellow) and the font (e.g. Helvetica or Script) for the date 
stamp. 
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FIG. 3 depicts framed options that can be selected by the user. The 
options include selecting the size of the print from a plurality of print sizes 150, 
including 4" x 6" size 152, 5" x 7" size 154, 8" x 10" size 156, and 14" x 16" size 
158. The user selects the size by selecting the appropriate print size icon (e.g. 
5 icon 152, 14, 156, or 158). The options also include selecting a matte style from a 
plurality of styles 160, including solid mattes 162 in gray, tan, and blue, textured 
mattes 1 64 in woodgrain, straw, or marble, and background image mattes 1 66 
including clouds, water, or flowers. The user selects the matte by selecting the 
appropriate radio button (e.g. one of buttons 162, 164, or 166) for their preferred 

10 matte style. The user then selects a picture frame style from a variety of styles 
170, including modem styles 172 in white, red, and black, classic styles 174 in 
walnut, oak, and black, and antique styles 176 in gold and silver. The user selects 
the picture frame style by selecting the appropriate radio button (e.g. one of 
buttons 172, 174, or 176) for their preferred frame style. Of course, many more 

1 5 size, matte, and frame options can be presented to the user using various types 

displays, such as pull-down menus, scroll bars, etc. The selected combination of 
print size, matte style and frame style is then presented to the user. For example, 
if the user selects a classic walnut frame with a texture wood grain matte, the 
Internet server 42 would present to the user an image depicting this combination 

20 for the user to review . 

FIG. 4 depicts album options that can be selected by the user. The 
options include selecting the size of the album from a plurality of sizes 200, 
including 5" x 7" size 202, 8" x 10" size 204, and 10" x 12" size 206. The user 
selects the size by selecting the appropriate print size icon (e.g. icon 202, 204, or 

25 206). The options also include using radio buttons 208 to select single-sided 
pages (e.g. print only on 1 side of the album page) or double-sided pages. The 
options further include selecting a preferred background style from a plurality of 
styles 210, including solid backgrounds 212 in white, gray, or tan, textured 
backgrounds 214 in wood grain, straw, or marble, and background images 216 

30 including clouds, water, or flowers. The user selects the background style by 

selecting the appropriate radio button (e.g. one of buttons 212, 214, or 216). The 
user then selects whether to include a page number from a plurality of options 
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using radio buttons 220. The options include no page numbers and several 
different styles of page numbers. The color, size, and font of the text used for the 
page numbers and image captions could also be selected using a separate menu 
(not shown). Finally, the user selects an album type from a plurality of album 
5 .types 230. The album type is selected by the user by selecting one of the radio 
buttons for bound albums 232, 3-ring albums 234 (including 1", 2", and 3" thick 
3-ring albums) or 20-ring albums 236 (including 1" and 2" thick albums). Of 
course, many more size, background, and album type options can be presented to 
the user using various types displays, such as pull-down menus, scroll bars, etc. 
10 The selected combination of album size, background, page numbers, and album 
type is then presented to the user. For example, if the user selects a 8" x 10" 
O double-sided album pages in a 3-ring, 2" thick binder with a marble texture 

m background and a particular page number style, the internet server 42 presents to 

£~? the user an image depicting this combination for the user to review. 

UJ 15 In block 114 of FIG. 2, the customer selects images to be uploaded 

j£ in order to be utilized in their selected type of photo product. In a preferred 

embodiment, the CPU 12 displays on the display monitor 14 a display screen 400 
O as shown in FIG. 7. The display screen 400 includes a two-dimensional array of 

fg thumbnail images 402 obtained from the digital camera 6, the CD reader 2, or the 

« 20 hard drive 20. The thumbnail images 402 preferably are thumbnail images stored 

within the Exif/JPEG image files provided by the digital camera 6. The user 
selects all of the images, or a subset of the images, by clicking the mouse 18 on 
the "select all" icon 432, or on any number of thumbnail images 402. FIG. 7 
shows that four thumbnail images 402a, 402b, 402c, and 402d (which are 
25 outlined) have been selected. 

In order to select desired images from a large number of thumbnail 
images 402, arrow controls 404 on the right portion of the display screen 400 
enable the user to scroll through the larger number of thumbnail images 402 to 
view a group of the thumbnail images 402 (e.g., 15 thumbnail images) at a time. 
30 The user can then select additional images (e.g., three images) to be printed by 
again pressing the control key or the shift key on the keyboard 16 while clicking 
the mouse 18 on any number of thumbnail images 402. 
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As the user selects images, an image data upload indicator 406 
displays the number of images selected for uploading 408 (e.g. 27 images), as well 
as other information such as the total size of all of the selected files 410 (e.g. 12.1 
Mbytes total for all selected images) and the estimated time for image uploading 
5 412 (e.g. 50 minutes) given the data rate of the user's modem 22 (e.g. 32 kbit/sec 
average net upload speed). 

In block 116, the user selects their preferred upload time using 
upload time selector 420 in FIG. 7. The options include immediately after 
completing the order process 422, waiting until the user logs off his computer 424, 

10 or waiting until a particular time selected by the user 426. The user may enter a 
different time, in place of the default time of 1 :00 am local time, using the 
keyboard 16 or by clicking the mouse 18 on the up/down arrows 428. In 
alternative embodiments, the user may also select a time for uploading images 
from a list of preferred times provided by the fulfillment center 40, or after a 

15 preselected number of minutes of inactivity (e.g. after 10 minutes of inactivity), or 
concurrently in the background as a low priority task. Finally, the user clicks on 
the "done" icon 430. At this point, the user is presented with one or more display 
screens (not shown) depicting the final products to be delivered, and confirming 
the cost of the products. The user can then approve the order and log off of the 

20 Internet site. 

In block 118, the image identifiers corresponding to the customer's 
selected images, the customer's selected upload time, and the customer's selected 
photo product options are added to the user's service account information. The 
image identifier can be the image file name, if all images to be uploaded are 

25 located in the same folder or directory on the user's computer 10, such as the same 
folder or directory on the hard drive 20. Alternatively, the image identifier can be 
a complete pathname specifying the storage device and the directory structure 
needed to locate each image. Alternatively, the image identifier can be data string 
which matches a data string within the corresponding image file, such as an GUID 

30 (globally unique ID), and image number, an image title, or the like. 

As shown in the example depicted in FIG. 5, the service account 
information can include information for several products having different 
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identifiers (ID) such as Product ID-1 (lines 13-25) which specifies a customized 
album, Product ID-2 (lines 27-34) which specifies a framed print, and Product ID- 
3 (lines 36-43) which specifies customized service prints. The album related 
information (lines 13-25) includes the page size, album type, and background 
5 style selected. It also includes page number information, such as the style, font, 
and color of the text, and the last page number printed. The last page number 
information is updated each time new album pages are printed. It can be used to 
automatically tell the user when an album has been filled, and a new album needs 
to be purchased. The album related information also includes a list of image 

10 numbers (line 23) to be included in the album. These image numbers correspond 
to image identifiers listed in the Image upload list section (lines 47-65) of FIG. 5. 
The album related information also indicates that designee #2 should receive the 
order (line 24) and the order status (line 25). The order status indicates that this 
photo product has been ordered by the user, but not yet fulfilled. Once fulfilled, 

15 the status will be updated to indicate that this order has been completed. 

The framed print information (lines 27-34) specifies the frame 
size, frame style and color, and matte style. It also includes a list of image 
numbers (line 32) to be used to produce the framed print. This image number 
(Image number 3) corresponds to image identifier listed for image number 3 in the 

20 Image upload list section (line 50) of FIG. 5, which is the image identified as 

/D/DCIM/100DC280/DCP_0017.JPG, the path name of the image on the user's 
computer 10. The information also indicates that designee #2 should receive the 
order (line 33) and the order status (line 34). 

The service print information (lines 36-43) specifies the print size, 

25 print finish, and the location, font style, size, and color of the date to be overlaid in 
the print. It also includes a list of image numbers (line 41) to be printed. The 
information also indicates that designee #1 should receive the prints (line 42) and 
the order status (line 43). The service print information could also specify other 
text or graphics selected by the user that should be added to the images when they 

30 are printed. 

The upload time information (lines 45-46) indicates the user 
selected upload time. At line 46, it indicates an upload time of 1 :00 am eastern 




-14- 



standard time (EST). The upload time information could alternatively indicate 
"immediately" or "as user logs off. 

The image upload list (lines 47-65) provides a list of image 
identifiers corresponding to the images to be uploaded, which were selected by the 
5 user in block 114. The upload list provides a reference number (e.g. Image 1), a 
pathname to the image file on the user's computer which is to be uploaded (e.g. 
/D/DCIM/100DC280/DCP_0012.JPG). This pathname points to the JPEG/Exif 
image named DCP__0012.JPG located in the folder named 100DC280 within the 
folder named DCIM on the "D" drive of the user's computer 10, which in this 

10 example is the drive name used for the digital camera 6. The upload list also 
includes an upload status for the image (e.g. "To be uploaded"). As the images 
are uploaded, this status is updated. In case of interruptions or errors, only those 
images not yet uploaded will need to be transferred. 

The service print information is stored in electronic database 44. 

1 5 Alternatively, some or all of the service print information could instead stored on 
hard drive 20, or could be duplicated on hard drive 20 of home computer system 
10. When all the necessary service print information has been captured, the 
fulfillment center 40 can send a message confirming the receipt of the service 
order. 

20 In block 120, at the indicated time, the digital images are uploaded 

to the service provider. The upload time is the time selected by the user in 1 16. 
In some cases, this is immediately after the user confirms the order. In other 
cases, the images are uploaded when the user initiates the process of shutting 
down their computer. In this situation, the images are transferred, and then the 

25 shut down process is completed. In other cases, the images are transferred at a 
specified time, typically at night when the user's computer and phone line are 
unlikely to be needed. Of course, this requires that the user's computer remain 
powered on, or in a low power standby state until it is "woken up", for example by 
the task scheduler program in Microsoft Windows 98. As the images are 

30 uploaded, the image upload status (lines 48-65 in FIG. 5) are updated to indicate 
which images have been successfully uploaded. In the unlikely event that the 
consumer needs the phone line while the image uploading is being conducted, the 
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up loading will terminate. This can be noted by the user's computer 10 or the 
network server 42, which can automatically re-establish the connection at a later 
time, via the network service provider 30, and upload the images having a status 
of "To be uploaded". 

5 After all the images are uploaded, in block 122, the the fulfillment 

center 40 can send a message to the user's email account to confirm receipt of the 
images, and production controller 52 produces the customized photo products 
using the uploaded images and the service print information stored in electronic 
database 44. If the user has ordered an album, the uploaded digital images can be 

10 automatically arranged on the pages and printed by color hardcopy printer 54 to 
produce album pages 56 as described in commonly assigned U.S. Patent 
Application Serial No. 09/347,310, filed July 2, 1999 to Loui et al.; U.S. Patent 
Application Serial No. 09/199,724, filed November 25, 1998 to Shaffer et al; and 
Serial No. 09/199,639, filed November 25, 1998 to Shaffer et al., the disclosures 

15 of which are herein incorporated by reference. The last page number (line 22) in 
the service account information depicted in FIG. 5 is updated to reflect the number 
of album pages that will be produced to show the uploaded images. Alternatively, 
as part of block 114, the user can manually arrange the images on the pages and 
also select preferred colors, messages, logos, or images for the custom album 

20 cover 62. 

If the user has ordered framed prints, the digital images are printed 
using color hardcopy printer 54 to produce hardcopy prints 58. Each hardcopy 
print 58 includes the user selected matte border, for example the texture - wood 
grain border specified in line 31 of FIG. 5. Each hardcopy print 58 is then framed 

25 using the appropriate frame 68, for example the classic - walnut frame specified in 
line 30 of FIG. 5. If the user has ordered service prints, the digital images are 
printed using color hardcopy printer 54 to produce hardcopy prints 58. The 
hardcopy prints 58 use the size and finish specified in lines 38-39 of FIG. 5. 
Before printing, each digital image is overlaid with the date stamp as specified in 

30 line 40 of FIG. 5. If the user has ordered one or more PictureCDs using the 
uploaded images, the PictureCDs 78 are produced using CD Writer 76. 
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In block 124, the production controller 52 in FIG. 1 controls the 
shipping label printer 70 to produce the shipping label 74 using the shipping 
address of the customer or customer's designee provided in the service account 
information (FIG. 5). The shipping label 74 is attached to the shipping container 
5 64 that is used to ship the photo product 66. 

In block 126, the customer account provided in the service account 
information (FIG. 5) is billed for the order. At this point, the financial institution 
having the customer's account designates such funds for transfer to the product 
provider or seller. 

10 In block 128, the photo product 66 incorporating the first group of 

digital images is delivered to the customer or the customer's designee. The term 
"delivery" means that the photo product 66 can be shipped to the customer or the 
customer's designee by the U.S. Postal Service (USPS) or by a carrier service, 
such as the United Parcel Service (UPS) or Federal Express. Alternatively, the 

15 photo product 66 can be delivered to a location such as the store where the retail 
kiosk 80 is located, where the customer can pick it up. In this case, the billing 
provided in step 126 can be delayed until the customer picks up the photo product 
66, and the customer can then pay for the photo product 66 using cash, check, or a 
charge/debit card. 

20 After the photo products are shipped to the user in block 124, the 

digital images uploaded by the user in step 116 can be deleted from electronic 
database 44 in FIG. 1 if the user does not request that they be maintained for long 
term storage and "sharing" via the Internet. The service account information in 
FIG. 5 is retained, however, so that it can be used for subsequent orders by the 

25 same customer. This typically occurs many weeks or months later, when the user 
wants to print additional images. At this time, the customer again logs onto the 
Internet site and enters their name and password, similar to block 100. 
Alternately, the home computer system 10 can include a "cookie" created and 
stored on hard drive 20 when the user first accessed the Internet site in step 100. 

30 This "cookie" can automatically identify the user account. In response, the 

network server 42 accesses, from the electronic database 44 in FIG. 1 , the service 
account information for the customer. The network server 42 provides a display 
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for the user based on the Product ID information stored in the user's service 
account. For example, if the user had selected a classic walnut frame with a 
texture wood grain matte in step 112, the Internet server 42 would present to the 
user an image depicting this combination for the user to review. If the user had 
5 also selected a 8" x 10" double-sided album pages in a 3-ring, 2" thick binder with 
a marble texture background and a selected page number style in step 112, the 
Internet server 42 would also present to the user an image depicting this 
combination for the user to review. The network server 42 also allows the user to 
select new types of products to purchase, and to customize the products, as 

10 provided earlier in blocks 106 to 1 12. 

The customer then selects another set of images to be uploaded, as 
described earlier in relation to block 114. As in block 114, this can be done by 
selecting to upload all the images from a particular CD inserted in CD reader 2 or 
stored in digital camera 6 or by individually selecting images to be uploaded. 

15 The user can use their default upload time stored in their service account, or can 
select a different upload time. The service account information is updated to 
reflect the new order information. At this point, the customer can be presented 
with one or more display screens showing the final products to be delivered, and 
confirming the cost of the products. The user may then approve the order and log 

20 off of the Internet site. 

At the appropriate time, this second group of digital images is 
uploaded, as described earlier in relation to block 120. The production controller 
52 then creates the photo products ordered by the user, as described earlier in 
relation to block 122. The production controller 52 then produces the customized 

25 photo products using this second group of images, and the service account 

information stored in electronic database 44. If the user has ordered an album, the 
last page number (line 22) in the service account information depicted in FIG. 5 is 
updated to reflect the number of album pages that will be produced to show the 
uploaded images. If the number of new album pages to be produced will exceed 

30 the capacity of the customer's current album (e.g. if the print count will be 54, 
which is more than 50 pages for the 2" thick binder in FIG. 4), the user is 
automatically advised that a new album will be ordered to store some of the new 
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album pages, and the page numbers printed on the album pages are numbered 
accordingly. In the above example, the last 4 pages (e.g. prints 51 to 54) are given 
page numbers 1 to 4 and provided in a new album, while the other pages will be 
included in the earlier 3 -ring album provided as part of the earlier order. 
5 Finally, the shipping label 74 is produced and attached to the 

shipping container 64, the customer account is billed for the order, and the photo 
product(s) incorporating the second group of images are shipped to the customer 
or customer's designee, as described earlier in relation to blocks 124 to 128. 

The user can of course repeat this process many times, with new 
10 groups of digital images, to simply and easily obtain similarly customized photo 
products. For example, the user can, over the course of several years, obtain a set 
O of frame prints having similar frame styles and matte colors, without needing to 

m re-enter, or even remember, the choices they had made for their earlier orders, 

f: FIG. 6 is a block diagram showing the electronic camera 6 in more 

y 15 detail. The electronic camera 6 produces digital images that are stored on the 

ir removable memory card 330. The electronic camera 6 includes a zoom lens 312 

" having zoom and focus motor drives 310 and an adjustable aperture and shutter 

O (not shown). The zoom lens 312 focuses light from a scene (not shown) on an 

rg image sensor 314, for example, a single-chip color CCD image sensor, using the 

y 20 well known Bayer color filter pattern. The image sensor 3 14 is controlled by 

clock drivers 306. The zoom and focus motors 310 and the clock drivers 306 are 
controlled by control signals supplied by a control processor and timing generator 
circuit 304. The control processor and timing generator 304 receives inputs from 
autofocus and autoexposure detectors 308 and controls a flash 302. The analog 
25 output signal from the image sensor 3 14 is amplified and converted to digital data 
by the analog signal processing (ASP) and analog-to-digital (A/D) converter 
circuit 316. The digital data is stored in a DRAM buffer memory 318 and 
subsequently processed by a processor 320 controlled by the firmware stored in 
the firmware memory 328, which can be flash EPROM memory. 
30 The processed digital image file is provided to a memory card 

interface 324 which stores the digital image file on the removable memory 
card 330. Removable memory cards 330 are known to those skilled in the art. 
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For example, the removable memory card 330 can include memory cards adapted 
to the CompactFlash Specification Version 7.3, published by the CompactFlash 
Association, Palo Alto, California, August 5, 1998. Other types of digital memory 
devices, such as magnetic hard drives, magnetic tape, or optical disks, could 
5 alternatively be used to store the digital images. 

The processor 320 performs color interpolation followed by color 
and tone correction, in order to produce rendered sRGB image data. The rendered 
sRGB image data is then JPEG compressed and stored as a JPEG image file on 
the removable memory card 330. The processor 320 also creates a "thumbnail" 

10 size image that is stored in RAM memory 326 and supplied to the color LCD 

image display 332, which displays the captured image for the user to review. The 
electronic camera 6 is controlled by user controls 303, such as a series of user 
buttons including a shutter release (e.g., capture button) (not shown) which 
initiates a picture taking operation. The graphical user interface displayed on the 

15 color LCD image display 332 is controlled by the user interface portion of the 
firmware stored in the firmware memory 328. 

After a series of images have been taken and stored on the 
removable memory card 330, the removable memory card 330 can be inserted into 
the card reader (not shown) in home computer 10. Alternatively, an interface 

20 cable 342 from can be used to connect between the host interface 322 in the 

electronic camera 6 and the CPU motherboard 12 in home computer system 10. 
The interface cable 342 can conform to, for example, the well known universal 
serial bus (USB) interface specification. 

The digital camera 6 can create an image utilization file listing the 

25 images to be printed, as described in commonly assigned U.S. Patent Application 
Serial No. 08/977,382, filed November 24, 1997 to Parulski et al., the disclosure 
of which is herein incorporated by reference. This image utilization file can 
digital print order format (DPOF) file. The DPOF file can be used to 
automatically identify the digital images to be uploaded, replacing block 1 14 in 

30 FIG. 2. 

The digital camera 6 can also store a service account identifier in 
the firmware memory 328, as described in commonly assigned U.S. Patent 
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Application Serial No. 09/534,469, filed March 24, 2000 to Parulski, the 
disclosure of which is herein incorporated by reference. The service identification 
number can then be stored onto the removable flash memory 330, either as part of 
each image file, or as a separate digital record, so that it can be used to 
5 automatically access the service account for the user. 

A computer program product can include one or more storage 
medium, for example; magnetic storage media such as magnetic disk (such as a 
floppy disk) or magnetic tape; optical storage media such as optical disk, optical 
tape, or machine readable bar code; solid-state electronic storage devices such as 

10 random access memory (RAM), or read-only memory (ROM); or any other 
physical device or media employed to store a computer program having 
instructions for practicing a method according to the present invention. 

The invention has been described in detail with particular reference 
to certain preferred embodiments thereof, but it will be understood that variations 

15 and modifications can be effected within the spirit and scope of the invention. 
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PARTS LIST 



2 CD reader 

4 color scanner 

6 digital camera 

10 home computer system 

12 CPU motherboard 

14 display monitor 

16 keyboard 

1 8 mouse 

20 hard drive 

22 dial-in modem 

30 Internet service provider 

32 modem 

3 4 computers/routers 
36 channel 

40 fulfillment center 

42 network server 

44 electronic database 

46 billing system 

48 bill issuing 

52 album production controller 

54 color hardcopy printers 

56 album pages 

58 hardcopy prints 

60 album label printer 

62 custom album cover 

64 shipping container 

66 photo product 
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PARTS LIST (con't) 



68 frames 

70 shipping label printer 

74 shipping label 

76 CD writer 

78 PictureCD 

100 block 

102 block 

104 block 

106 block 

108 block 

100 block 

110 block 

112 block 

114 block 

116 block 

118 block 

120 block 

122 block 

124 block 

126 block 

128 block 

150 print sizes 

152 print size 

154 print size 

156 print size 

158 print size 



+ • 
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PARTS LIST (con't) 



160 matte styles 

162 solid mattes 

1 64 textured mattes 

166 background image mattes 

1 70 picture frame styles 

172 modern picture frame style 

174 classic picture frame style 

176 antique picture frame style 

202 album size 

204 album size 

206 album size 

208 radio buttons 

210 background style 

212 solid background style 

214 textured backgrounds 

216 background images 

220 radio button 

230 album types 

232 bound albums 

234 3 -ring albums 

236 20-ring albums 

302 flash 

303 users controls 

304 control processor and timing generator circuit 
306 clock drivers 

308 autofocus and autoexposure detectors 

310 zoom and focus motor drives 

312 zoom lens 

314 image sensor 
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PARTS LIST (con't) 



316 analog signal processing and analog-to-digital converter circuit 

3 1 8 DRAM buffer memory 

320 processor 

322 host interface 

324 memory card interface 

326 RAM memory 

328 firmware memory 

330 removable memory card 

332 color LCD image display 

342 interface cable 

400 display screen 

402 thumbnail images 

402a thumbnail image 

402b thumbnail image 

402c thumbnail image 

402d thumbnail image 

404 arrow controls 

406 upload indicator 

408 number of images 

410 total file size 

412 transfer time 

420 upload time selector 

422 immediate option 

424 logoff option 

426 time option 

428 up/down arrows 

430 done icon 

432 select all icon 



